Head-mounted displays and attachments that enable interactive sensory experiences

ABSTRACT

Introduced herein are techniques for producing sensory stimuli that increase the realism of content experienced by a user. Several embodiments pertain to scent delivery system that are able to dispense scented material(s) to the user. A scent delivery system could be a self-contained unit that is attachable to a head-mounted display (HMD) or could be integrated into the HMD itself. The scent delivery system can be used to improve the realism of content (e.g., visual content and audio content) presented to the user. More specifically, the scent delivery system can be configured to dispense one or more scented materials in response to determining a particular scene is being shown. Different scented materials can be dispensed based on characteristics of the content. In some embodiments, the scented material(s) are held in capsules that are housed within the scent delivery system. The capsules may be readily replaceable by the user.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/469,397, titled “HEAD-MOUNTED DISPLAYS AND ATTACHMENTS THAT ENABLEINTERACTIVE SENSORY EXPERIENCES” and filed Mar. 24, 2017, which is acontinuation-in-part of U.S. patent application Ser. No. 15/081,556,titled “SCENT DISPERSAL SYS IEMS FOR HEAD-MOUNTED DISPLAYS” and filed onMar. 25, 2016, which claims priority to U.S. Provisional PatentApplication No. 62/311,347, titled “HEAD-MOUNTED DISPLAYS THAT ENABLEINTERACTIVE SCENT EXPERIENCES” and filed on Mar. 21, 2016, each of whichis incorporated by reference herein in its entirety.

RELATED FIELD

The present technology relates to display devices for digital contentand, more specifically, display devices that enable users to participatein interactive scent experiences while viewing virtual or augmentedreality content.

BACKGROUND

Smell is one of our strongest senses. Certain scents often remind us ofmoments (both good and bad) that we first experienced days, weeks, oryears ago. Scents can also make be highly effective in helping usdistinguish items or locations from one another.

Some businesses (e.g., production studios, movie theaters, and amusementparks) have long attempted to enhance interactive experiences byintroducing scents. For example, “Smell-O-Vision” was a system thatreleased scents during the projection of a film so that the viewer could“smell” what was happening in the movie. Similarly, the “Smellitizer”was developed by the Walt Disney Company to deliver faint scents on cueat certain locations, such as attractions (e.g., Soarin' OverCalifornia® at Disneyland®) and storefronts (e.g., Main Street Bakery).Scent dispersal systems such as these were often shown to heighten therealism of a fabricated experience, increase sales, and improve customersatisfaction.

Accordingly, entities across different industries have begun using scentas part of a multi-sensory marketing strategy designed to enhance anindividual's experience (e.g., of a location or a particularproduct/service). These enhanced experiences allow customers to developdeeper memories and emotional connections with certain brands, products,services, locations, etc. In fact, some brands have begun using scent todistinguish themselves in the market. Such techniques are generallyperformed as part of a scent marketing campaign.

Scent marketing campaigns can typically be readily introduced bymerchants who occupy a physical storefront. However, scent marketingbecomes increasingly difficult as merchants complete more transactionselectronically and reduce the number of physical storefronts. Saidanother way, the proliferation of electronic transactions has made scentmarketing more difficult because scents must be delivered to prospectivecustomers.

Scent has also been proposed as one way of increasing the realism ofdigital content that is experienced by an individual on a computingdevice, such as a mobile phone, television, or virtual/augmented realityheadset. For example, an individual's sense of smell can be tricked byreplacing unrelated real-world stimuli with controlled stimuli. Butdelivering these scents to the individual at the appropriate time(s) inthe appropriate amount(s) using conventional technology is difficultand, in many instances, impossible.

Scent is simply one example of a sense that is typically isolated fromexperiencing content presented by a computing device. In fact, therealism of digital content (e.g., augmented or virtual reality content)has been limited because only a single sense (i.e., the visual sense) isengaged. Increasing the realism and engagement of various experienceswill depend on effectively engaging multiple senses (e.g., the olfactorysense, the gustatory sense, and the visual sense) simultaneously orsequentially.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention are illustrated by way of exampleand not limitation in the accompanying drawings, in which likereferences indicate similar elements. Various objects, features, andcharacteristics of the present invention will become more apparent tothose skilled in the art from a study of the following DetailedDescription in conjunction with the accompanying drawings.

FIG. 1A depicts a conventional head-mounted display (HMD) that includesan image display system and an optical display surface configured toreflect light.

FIG. 1B depicts a conventional HMD that includes an image display systemand an optical display surface configured to reflect light.

FIG. 2A is an inside view of a binocular HMD that includes a scentdelivery system.

FIG. 2B is a front view of the binocular HMD that includes a scentdelivery system.

FIG. 3 depicts an example of a network environment that includes an HMDhaving a scent delivery system, a content server, and another computingdevice.

FIG. 4 depicts a scent delivery system that can be affixed to an HMDconfigured to display augmented or virtual reality content.

FIG. 5A depicts scent capsules that can be installed within a scentdelivery system.

FIG. 5B depicts an interface that is associated with an HMD configuredto dispense scent(s).

FIG. 5C depicts an interface through which a user can browse itemsoffered for sale by an electronic commerce platform.

FIG. 6 depicts a process for attaching a scent delivery system to anHMD.

FIG. 7 depicts a process for dispensing one or more scented materials bya scent delivery system that is attached to an HMD.

FIG. 8 is a block diagram illustration an example of a processing systemin which at least some operations described herein can be implemented,consistent with various embodiments.

The figures depict various embodiments for the purpose of illustrationonly. One skilled in the art will readily recognize from the followingDetailed Description that alternative embodiments of the technologyillustrated herein may be employed without departing from the principlesof the technology.

DETAILED DESCRIPTION

Introduced here are computer-implemented techniques and systems forincreasing the realism of experiences involving digital content bydispensing scent(s). More specifically, scent delivery systems (alsoreferred to as “scent-enabling units”) are described herein that candispense one or more scents based on the digital content being shown toan individual at a given point in time. A scent delivery system may beseparately attachable to a computing device or may be integrated withinthe computing device itself.

Although many of the embodiments described herein involve head-mounteddisplays (HMDs), one skilled in the art will recognize that suchembodiments have been selected for the purposes of illustration only.Such technology could be used in combination with any computing devicethat present digital content, including personal computers, tabletcomputers, personal digital assistants (PDAs), mobile phones, gameconsoles (e.g., Sony PlayStation® or Microsoft Xbox®), music players(e.g., Apple iPod Touch®), wearable electronic devices (e.g., a watch orfitness band), network-connected (“smart”) devices (e.g., a television),virtual/augmented reality systems (e.g., Oculus Rift® or MicrosoftHololens®), or other electronic devices.

A scent delivery system can include one or more capsules or reservoirsof scented material (e.g., liquid or air) that can each be selectivelydispensed by a pump at the appropriate time. That is, the scent deliverysystem includes pump(s) for controllably dispensing the scentedmaterial(s) in certain quantities/mixtures at certain times. Forexample, a pine scent could be dispensed when the individual is able toview a digital forest through the HMD, while a vanilla scent could bedispensed when the individual is able to view a digital kitchen throughthe HMD.

Unlike traditional scent dispersal systems (e.g., the Smell-O-Vision orthe Smellitizer), the scent delivery systems described herein arereadily portable and allow scents to be delivered directly to anindividual user of an HMD. Said another way, traditional scent dispersalsystems are designed to dispense scents in a single physical location,while the scent delivery systems introduced here can be used regardlessof where the individual decides to experience digital content. Dispersalof the scents typically enhances the realism of digital content (e.g.,augmented or virtual reality content) that is viewed by an individual byreplacing unrelated real-world stimuli with controlled stimuli. Saidanother way, the scent dispersal systems increase the realism of digitalcontent by tricking the user's olfactory sense (i.e., sense of smell).For example, an individual may smell certain predetermined combinationsof scent(s) while viewing digital content on an HMD rather than scentsthat are emanating from a kitchen (which are completely unrelated to thedigital content, and thus decrease realism).

Content (e.g., audiobooks and digital content, such as applications,games, and cinematic videos) may be specially designed for use with acomputing device having a scent delivery system. In such embodiments, aprocessor can determine whether to dispense a scent based oninstructions provided by a source of the content. In some embodimentsthe instructions are embedded within the content (e.g., in the metadataof a cinematic video), while in other embodiments the instructions areincluded in an instruction set that accompanies the content and isseparately executable by the processor.

However, older, non-scented content could also be repurposed for usewith a computing device having a scent delivery system. For example, anadministrator (e.g., a designer, writer, or individual consumer ofcontent) may be able to tag non-scented content to create keyframes thatcause the scent delivery system to dispense scent(s). More specifically,the administrator could access a network-accessible interface and uploadthe non-scented content to a repurposing engine that analyzes thenon-scented content and determines characteristics regarding howscent(s) should be dispensed. The characteristics could include, forexample, how much of each scent should be dispensed (e.g., faint,medium, or strong aroma), when each scent should be dispensed, whethercertain scent combinations should be created, etc. In some embodiments,the administrator is able to specify and/or modify these characteristicsthrough the network-accessible interface.

Thus, non-scented content could be manually repurposed into scentedcontent by an administrator and/or automatically repurposed into scentedcontent by the repurposing engine. The repurposing engine may alsoengage in machine learning to identify keyframes, identify theappropriate scent(s) to be dispensed at those keyframes, etc. Forinstance, the repurposing engine may apply a Naïve Bayes Classifieralgorithm, a K Means Clustering algorithm, a Support Vector Machinealgorithm, linear regression, logic regression, artificial neuralnetworks, etc. These machine learning algorithms/techniques may bechosen based on application (e.g., supervised or unsupervised learning)and optimized based on whether the administrator has confirmedautomatically-selected keyframes, indicated the scent(s) created a morerealistic/desirable experience, etc.

Terminology

Brief definitions of terms, abbreviations, and phrases used throughoutthe specification are given below.

Reference in this specification to “one embodiment” or “an embodiment”means that a particular feature, structure, or characteristic describedin connection with the embodiment is included in at least one embodimentof the disclosure. The appearances of the phrase “in one embodiment” arenot necessarily referring to the same embodiment, nor are theynecessarily referring to separate or alternative embodiments that aremutually exclusive of one another. Moreover, various features aredescribed that may be exhibited by some embodiments but not others.Similarly, various requirements are described that may be requirementsfor some embodiments but not others.

Unless the context clearly requires otherwise, the words “comprise,”“comprising,” and the like are to be construed in an inclusive sense,rather than an exclusive or exhaustive sense (i.e., tin the sense of“including, but not limited to”). The terms “connected,” “coupled,” orany variant thereof includes any connection or coupling, either director indirect, between two or more elements. The coupling or connectionbetween the elements can be physical, logical, or a combination thereof.For example, two devices may be coupled directly to one another or viaone or more intermediary channels/devices. As another example, twodevices may be coupled in such a way that information can be passedthere between, despite not sharing any physical connection with oneanother. The words “associate with,” meanwhile, mean connecting orrelating objects, items, etc.

Where the context permits, words used in the singular sense or theplural sense may also be used in the plural sense or the singular sense,respectively. The word “or,” in reference to a list of two or moreitems, covers all of the following interpretations of the word: any ofthe items in the list, all of the items in the list, and any combinationof the items in the list. If the specification states a component orfeature “may,” “can,” “could,” or “might” be included or have acharacteristic, that particular component or feature is not required tobe included or have the characteristic in every embodiment.

The term “module” refers broadly to software, hardware, and/or firmwarecomponents. Modules are typically functional components that cangenerate useful data or other output using specified input(s). A modulemay or may not be self-contained. A software program or application mayinclude one or more modules.

The terminology used in the Detailed Description is intended to beinterpreted in its broadest reasonable manner, even though it is beingused in conjunction with certain embodiments. The terms used in thisspecification generally have their ordinary meanings in the art, in thecontext of the disclosure as a whole and in the specific context whereeach term is used. For convenience, certain terms may be highlightedusing, for example, capitalization, italics, and/or quotation marks. Theuse of highlighting has no influence on the scope and meaning of a term;the scope and meaning of a term is the same, in the same context,whether or not it is highlighted.

Consequently, although alternative language and synonyms may be used forsome terms. Although synonyms for certain terms may be provided, specialsignificance is not to be placed upon whether or not a term iselaborated or discussed herein. A recital of one or more synonyms doesnot exclude the use of other synonyms. The use of examples anywhere inthis specification, including examples of any terms discussed herein, isillustrative only. These examples are not intended to limit the scopeand meaning of the disclosure or of any exemplified term. Likewise, thedisclosure is not limited to various embodiments described in thisspecification.

System Overview

FIGS. 1A-B depict conventional head-mounted displays (HMDs) 100 a-b thateach include an image display system 102 a and an optical displaysurface 104 a-b configured to reflect or emit light. Some conventionalHMDs are designed so that digital content emitted by the image displaysystem 102 a is reflected by the optical display surface 104 a-b towardsthe user's eyes. Other conventional HMDs are designed so that digitalcontent created/processed by the image display system 102 a is projecteddirectly into the user's eyes by the optical display surface 104 a-b.

Conventional HMDs 100 a-b can cover one or both of the user's eyes. Morespecifically, binocular HMDs present a separate image to each of theuser's eyes, while bi-ocular HMDs present a single image to both of theuser's eyes, and monocular HMDs present a single image to only one ofthe user's eyes. However, as shown by FIGS. 1A-B, conventional HMDs 100a-b do not cover the user's nose or mouth, which separates or isolatesthe user's critical senses. For example, the HMDs 100 a-b shown hereisolate the user's olfactory sense (i.e., sense of smell) and gustatorysense (i.e., sense of taste) from the user's visual sense.

Consequently, a user of a conventional HMD will continue to receivestimuli from the real world that can disrupt the realism of theaugmented or virtual reality content shown by the HMD. In fact, some ofthese stimuli may be partially or entirely counter to what the userexpects. For example, the user might smell a fried chicken scent that isemanating from the kitchen while viewing a virtual environment (e.g.,the inside of an spaceship) through an HMD. Unrelated stimuli are likelyto cause the user to have a disjointed and unrealistic experience whileusing the HMD.

HMDs can be configured to display two different types of digitalimagery. First, some HMDs are configured to display simulated (e.g.,computer-generated) digital images that together form an entirelyvirtual environment. This is referred to as “virtual reality.” Virtualreality generally requires the user wear a helmet, goggles, or someother headwear that forms an enclosed area around the user's eyes,thereby blocking out the real-world. Second, some HMDs are configured todisplay simulated (e.g., computer-generated) images that aresuperimposed onto real world content perceived by the user. This isreferred to as “augmented reality.” Augmented reality allows the user toconcurrently view virtual imagery and real world imagery and, in someinstances, interact with virtual content that relates to what is seenthe real world. Generally, the user is able to distinguish between thevirtual content and the real world imagery. For example, augmentationmay take place through superposition of a simulated image on anon-simulated, real world environment. The simulated image may allow theuser to view additional data relevant to a desired task, thenon-simulated, real world environment, etc. The simulated image couldalso be adapted to allow for user interaction. However, augmented andvirtual reality experiences are generally limited in how realistic theyare because they are largely visual experiences.

HMD systems fall into three general categories: binocular systems,bi-ocular systems, and monocular systems. Binocular HMD systems presenta separate image to each of the user's eyes, while bi-ocular HMD systemspresent a single image to both of the user's eyes, and monocular HMDsystems present a single image to only one of the user's eyes. Oneskilled in the art will recognize that the systems and techniquesdescribed herein can be adapted for any of these systems. The use of oneor more of these terms in describing an embodiment is for the purposesof illustration only.

HMDs enable users to more easily interact with augmented or virtualreality assets. The assets can include, for example, network-accessibleinterfaces (e.g., that are accessible through a web browser), softwareprograms/applications, video games, and cinematic videos. HMDs couldalso be designed to facilitate non-visual experiences as well. Forexample, many conventional HMDs include (or can be easily paired with)headphones or speakers through which audio assets (e.g., songs andaudiobooks) can be projected.

FIG. 2A is an inside view of a binocular HMD 200 that includes a scentdelivery system 202. FIG. 2B is a front view of the binocular HMD 200that includes a scent delivery system 202. The scent delivery systemsdescribed herein enhance the realism of digital content (e.g., augmentedor virtual reality content) shown to a user by replacing real-worldstimuli with controlled stimuli that are related to the digital contentbeing viewed by the user. Said another way, the scent delivery systemscan increase the realism of digital content by tricking the user'solfactory sense (i.e., sense of smell).

As further described below, the scent delivery system 202 can becompletely self-contained or could be integrated into the binocular HMD200. For instance, in some embodiments the scent delivery system 202 isdetachably connectable to the frame of the binocular HMD 200 using oneor more fasteners (e.g., magnets, mechanical clips/tracks, or some otherquick release mechanisms). The fastener(s) allow the scent deliverysystem 202 to be readily attached to, and then removed from, thebinocular HMD 200 without the use of tools. For example, the structuralframe of the binocular HMD 200 may include fasteners (e.g., cavities)configured to mate with corresponding features (e.g., protrusions) of ascent delivery system 202. In other embodiments, the scent deliverysystem 202 is fixedly attached to the frame of the binocular HMD 200using, for example, screws, nuts and bolts, or an adhesive material.

Additionally or alternatively, some or all of the components that enablescent to be dispensed (e.g., pumps, reservoirs, and/or fans) could beintegrated within the HMD. For example, the pump(s) and reservoir(s) maybe integrated into the structural frame of an HMD (and thus noattachment may be necessary). In such embodiments, the pump(s) may bedisposed such that scent(s) are ejected toward the user's nose.

One skilled in the art will recognize that embodiments involving abinocular HMD are described herein for the purposes of illustrationonly. The scent delivery systems and computer-implemented techniquesdescribed herein are equally applicable to monocular HMDs, bi-ocularHMDs, and other computing devices (e.g., mobile phones, televisions, andwearable devices). In some embodiments, the scent delivery system 202 iscustomizable for a particular user, a particular type of experience(e.g., augmented or virtual reality content), a particular HMD (e.g.,Oculus Rift® or Microsoft Hololens®), etc.

The scent delivery system 202 can be designed so that it partially orentirely covers the user's nose. For example, FIGS. 2A-B depict a scentdelivery system 202 that completely envelops the user's nose. However,the scent delivery system 202 could instead be designed so that the baseof the user's nose is exposed. In some embodiments, some of thecomponents (e.g., the pumps 204, reservoirs 206, and/or fan 208) areintegrated into the structural frame of the binocular HMD 200 so thatthe binocular HMD 200 appears similar to a conventional HMD (e.g., theHMDs of FIGS. 1A-B) despite supporting scent functionality.

More specifically, the scent delivery system 202 can include astructural frame 210, one or more pumps 204, one or more reservoirs 206,and a fan 208. The structural frame 210 can include features that allowthe scent delivery system 202 to be readily connected to, and thenremoved from, the binocular HMD 200. For example, the structural frame210 could include fasteners (e.g., detents or cavities) configured tomate with corresponding features (e.g., protrusions) of the scentdelivery system 202. Examples of fasteners include magnets, mechanicalclips/tracks, and other quick release mechanisms. In other embodiments,the scent delivery system 202 is fixedly attached to the structuralframe 210 using screws, nuts and bolts, adhesive materials/substances,etc.

The pump(s) 204 allow a scented material (e.g., liquid or air) stored inthe reservoir(s) 206 to be dispensed in a controlled manner. Forexample, the pump(s) 204 could dispense scented liquids in particularquantities, at particular temperatures, with particular forces, etc. Infact, the pump(s) 204 could be collectively controlled by scentcircuitry that can intelligently cause dispersal of a single scentedmaterial and combinations of multiple scented materials. Said anotherway, the pump(s) 204 could sequentially or simultaneously dispense thescented materials stored in the reservoir(s) 206.

In some embodiments the pump(s) 204 spray a scented material directlytoward the user's nose, while in other embodiments the pump(s) 204 spraythe scented material within the internal cavity of the structural frame210 (in which case the fan 208 could direct the scented material towardsthe user's nose or away from the user's nose). As further describedbelow, the pump(s) 204 may dispense a small quantity of a single scentedmaterial when a slight aroma is desired, a large quantity of a singlescented material when a strong aroma is desired, small or largequantities of multiple scented materials simultaneously, etc.

Scent could also or instead be delivered via small absorbent pads thatare connected to the reservoir(s) 206 and are disposed near the user'snose. For example, one or more absorbent pads could be affixed on aninterior surface of the structural frame 210 of the scent deliverysystem 202 (i.e., within the internal cavity). Unlike the pump(s) 204(which are able to selectively dispense scented materials at certaintimes), the absorbent pads typically continually dispense small amountsof scented material.

The reservoir(s) 206 generally retain air or liquid having differentscents. For example, the three reservoirs depicted in FIGS. 2A-B maycorrespond to general scents (e.g., sweet, savory, and floral), specificscents (e.g., cinnamon, citrus, and roses), or some combination thereof.Moreover, the reservoirs may be readily replaceable by the user or someother entity (e.g., the manufacturer of the HMD or a servicerepresentative). In such embodiments, the reservoirs could be replacedby “capsules” of scented material that are easily replaceable and enablethe user to customize which scent(s) can be created by the scentdelivery system 202.

Note, however, that one or more of the reservoir(s) 206 could alsoinclude a non-scented material (e.g., water) or a neutrally-scentedmaterial that is controllably dispensed within the internal cavity toneutralize other scents. For example, a neutralizing scent (alsoreferred to as a “cleansing scent”) may be created to eliminateparticularly strong scents (e.g., a smoke odor or food-based odor) orunwanted scents (e.g., a skunk odor) the user is unlikely to want tolinger. The neutrally-scented material could also include particles(e.g., natural oils) that eliminate scents by attaching to odormolecules to form a neutral compound. Neutrally-scented material(s) areoften circulated by the fan 208 to more quickly flush scent(s) from theinternal cavity of the structural frame 210.

In some embodiments, the scented material(s) stored in the reservoir(s)206 also include a flavor compound having a particular taste. Thus, theuser may experience content using her visual, olfactory, and/orgustatory senses. For example, when the user views a digital environmentthat includes a citrus grove, the binocular HMD 200 may dispense amaterial (e.g., air or liquid) having a citrus scent and/or a citrustaste. Scent and taste could be facilitated by a single material ormultiple materials. For example, the binocular HMD 200 could include onereservoir that stores a material having a scent-enabling compound andanother reservoir that stores a material having a taste-enablingcompound. As another example, the scent-enabling compound and thetaste-enabling compound may both be included in the same material thatis stored in a single reservoir.

The fan 208 could be set to continuously or periodically circulate airaround the user's nose. For example, the fan 208 may only circulate airwhen the scent delivery system 202 begins dispensing scented material(s)or when the user enables the fan 202 (e.g., turns a fan setting to“on”). In some embodiments, the structural frame 210 includes one ormore openings (also referred to as “breaks” or “outlets”) that allow airto more easily circulate through the internal cavity of the structuralframe 210. These opening(s) may be strategically positioned with respectto the user's noise (e.g., near the nostrils as shown in FIGS. 2A-B) orwith respect to the pump(s) 204 and/or fan 208.

The fan 208 may also be used to modify the airflow in or around theinternal cavity of the structural frame 210. Different attributes (e.g.,acceleration, velocity, and temperature) could be modified to simulatewind that is included in content presented by the binocular HMD 200. Forexample, the fan 208 may intelligently switch between several fansettings to simulate different airflows while the user plays a racingvideo game. The fan 208 may perform such actions in combination with thepump(s) 204. For example, the fan 208 may cause high airflow and a pumpmay dispense a material having a salty flavor (e.g., a salty smell, asalty taste, or both) while the binocular HMD 200 presents appropriatecontent, such as a cinematic video involving the ocean or a video gameinvolving a golf course near the coast.

In some embodiments, the binocular HMD 200 also includes otherstructural features or components that enhance the user experience. Forexample, the binocular HMD 200 may include one or more sensors 212 thatare positioned proximate to the user's face. The sensor(s) 212 canmeasure skin temperature, temperature within the internal cavity,humidity, motion, etc. Scent circuitry 214 may be responsible formodifying which scented material(s) are dispensed, how much of eachscented material is dispensed, etc., based on signals received from eachof the sensor(s) 212. For example, if the sensor(s) 212 indicate thatthe skin temperature has begun to rise and the user has begun to sweat,the scent circuitry 214 may lessen the amount of scented materialdispensed by each pump to avoid overstimulation of the user's senses. Asanother example, if the sensor(s) 212 indicate that the user has begunto move her head toward the scent source (e.g., toward a flower shown inthe digital content), the scent circuitry 214 may increase the amount ofscented material dispensed by each pump to increase scent intensity.

The scent circuitry 214 (which may also be referred to as an“electronics module”) can process signals generated by each of thesensor(s) 212 and optimize the delivery of scented material(s) by thepump(s) 204. The scent circuitry can include a power supply (e.g., abattery or an electrical coupling to the power supply of the HMD),memory, one or more processors, and/or a communication module thatallows the scent delivery system 202 to communicate with the binocularHMD 200 and/or another computing device (e.g., a mobile phone, tablet,personal computer, or server). Accordingly, the communication module mayallow the scent delivery system 202 to communicate over the Internet, alocal area network (LAN), a wide area network (WAN), a point-to-pointdial-up connection, a cellular network, etc. Additionally oralternatively, the communication module may communicate via a shortrange protocol (e.g., near-field communication (NFC), radio-frequencyidentification (RFID), Bluetooth).

Scented material(s) are preferably dispensed by the pump(s) 204responsive to what content is being shown or projected by the binocularHMD 200. For example, the scent circuitry 214 may specify that a floralscent should be dispensed when a flower is shown in a cinematic video.As another example, the scent circuitry 214 may specify that a pinescent should be dispensed when a character in an audio recording (e.g.,an audiobook) enters a forest. The scent circuitry 214 (as well as theother components of the scent delivery system 202) may be poweredthrough a wired or wireless medium. For example, in some embodiments thescent circuitry 214 includes an internal power supply (e.g., arechargeable battery or a single cell (i.e., button cell) battery),while in other embodiments the scent circuitry is electrically coupledto, and powered by, the binocular HMD 200.

In some embodiments, the binocular HMD 200 includes one or more heatingelements 218 that are disposed near the reservoir(s) 206 and/or pump(s)204. The heating element(S) 218 allow the materials stored in thereservoir(s) 206 to be dispensed at certain temperatures or in certainforms. For example, a heating element could be used to produce steamfrom water stored in a reservoir to increase the humidity within theinternal cavity of the structural frame 210.

One or more sensors 216 could also be disposed on the outer surface ofthe scent delivery system 202 and/or the binocular HMD 200. Thesensor(s) 216 may monitor various aspects of the user's ambientenvironment. For example, the sensor(s) 216 may include a cameraconfigured to capture the user's interactions with the localenvironment, a light sensor configured to track ambient illuminancelevels, an audio sensor configured to sense vocal commands, etc. Oneskilled in the art will recognize that many other types of sensors couldbe included and, in some instances, may be preferred. The type(s) ofsensor(s) 216 could be chosen based on whether the HMD system is adaptedfor a particular application. For example, an HMD designed for outdooruse may include a temperature sensor and a wind sensor to determinewhether additional scented material needs to be dispensed to counteracta windy environment.

Unlike traditional scent dispersal systems (e.g., the Smell-O-Vision orSmellitizer), the technologies described herein are readily portable andallow scents to be delivered directly to an individual user of an HMD.Said another way, traditional scent dispersal systems are designed todispense scents in a single physical location, while the scent deliverysystems introduced here can be used regardless of where the user devicesto experience content. Moreover, because the scent can be deliveredlocally (i.e., targeted to a particular user), other individuals who arenearby are not able to smell the dispensed scent(s) (and are thusundisturbed). Consequently, multiple users can experience realisticdigital content (e.g., augmented or virtual reality content) in closeproximity to one another despite having different preferences. Forexample, some users may enable the scent functionality while other usersmay opt to refrain from scented experiences.

As shown in FIG. 2A, in some embodiments the binocular HMD 200 includesone or more lighting elements 220 that are installed near the edges ofthe optical display surface. By intelligently illuminating the lightingelement(s) 220, the binocular HMD 200 can make the user believe asthough the optical display surface is larger than it truly is. Thelighting element(s) 220 are generally adjustable, thereby enabling thebinocular HMD 200 to establish a controlled lighting environment.Moreover, the lighting element(s) 220 can be used to further increasethe realism of content presented by the binocular HMD 200 in severaldifferent respects. For example, the lighting element(s) 220 could serveas a bias light or backlight by illuminating the periphery of the user'svision based on the digital content being shown (e.g., using a colorthat matches or complements colors of the digital content). As anotherexample, the lighting element(S) 220 could provide additional sensorystimuli (e.g., bright bursts of light in the user's peripheral visionduring an action movie or shooter video game). The lighting element(s)220 could produce white light and/or colored light.

FIG. 3 depicts an example of a network environment that includes an HMD302 having a scent delivery system, a content server 304, and anothercomputing device 306 (here, a television and game console). The HMD 302,content server 304, and/or computing device 306 can be connected via oneor more computer networks 308 a-c, which may include the Internet, localarea networks (LANs), wide-area networks (WANs), metropolitan areanetworks (MANs), cellular networks, etc. Additionally or alternatively,the HMD 302, content server 304, and/or computing device 306 maycommunicate with one another over a short-range communication protocol,such as Bluetooth, Near Field Communication (NFC), etc. Examples ofcomputing devices 306 include, for example, mobile phones, tabletcomputers, laptop computers, personal computers, network-connected(“smart”) televisions, game consoles (e.g., Sony PlayStation® orMicrosoft Xbox® game console), network-connected mobile gaming devices(e.g., Sony PSP®), television-connected devices (e.g., Roku®, Apple TV®,Google Chromecast®, Amazon FireStick®, Android TV®, Blu-ray Disc™players), other network-connected devices having an interface (e.g.,Apple iPod Touch® and Apple Watch®), etc.

Generally, the HMD 302 is responsible for generating and presentingcontent to a user. While the content is typically in the form ofaugmented or virtual reality content, other forms of content (e.g.,cinematic videos, real-time video feeds, audiobooks, and music) couldalso be presented to the user. The content server 304 and/or thecomputing device 306 can be coupled, wired or wirelessly, to the HMD302. For example, the HMD 302 may be communicatively coupled to thecomputing device 306 via an antenna, wireless communication module, etc.In some embodiments the content server 304 and/or the computing device306 are responsible for delivering content to the HMD 302, while inother embodiments the HMD 302 stores some or all of the content locally(e.g., within a memory).

When the HMD 302 is configured to generate virtual reality content, itmay only be communicatively coupled to the content server 304. However,when the HMD 302 is configured to generate augmented reality content, itcould be communicatively coupled to the content server 304 and/or thecomputing device 306. Consequently, the user of the HMD 302 may be ableto see augmented reality content when viewing video, listening to audio,or playing video games using the computing device 306. Moreover, in someinstances the computing device 306 presents content to the user whilethe HMD 302 simply enhances the realism of the content by generatingsensory stimuli (e.g., scents, tastes, and/or visual effects). That is,the HMD 306 may improve the user experience without presenting contentitself.

As noted above, in order to make these experiences more realistic, theHMD 302 (and, more specifically, the scent delivery system) may beconfigured to dispense one or more scents in particular instances. Forexample, the HMD 302 could dispense a floral scent when a virtual gardenis viewable within a digital environment presented by the HMD 302. Asanother example, the HMD 302 could dispense a vanilla scent and acinnamon scent when digital content is presented by the HMD 302 thataugments a cooking show shown by a television in the real world. Furtheryet, the HMD 302 could dispense a pine scent, a grass scent, or asaltwater scent when the user watches a golf show on a television in thereal world (and no content is being shown by the HMD). In fact, the HMD302 may switch between these scents as golfers play different holes indifferent environments. Thus, the HMD 302 may dispense scents regardlessof whether it is currently responsible for displaying digital content toa user.

The strength, direction, and frequency of the sensory stimuli producedby the HMD 302 generally correspond to features of the content that ispresented to the user by the HMD 302 and/or other computing device 306.In some embodiments the instructions for producing the sensory stimuliare produced by a source of the content, while in other embodiments theinstructions for producing the sensory stimuli are created (e.g., by theHMD 302 or the other computing device 306) after analyzing the contentto identify elements that are indicative of a sensory stimuli source.The instructions may be embedded in the content (e.g., in the metadataof a cinematic video) or included in a separate file that accompaniesthe content.

FIG. 4 depicts a scent delivery system 400 that can be detachableconnected to an HMD configured to display augmented or virtual realitycontent. The scent delivery system 400 can include a compartment 404that is able to hold one or more reservoirs 402 of scented material(e.g., air or liquid). Each scent may correspond to a separate,interchangeable “capsule” that can be easily removed from the scentdelivery system 400. The removable capsules may correspond to a generalscent or a specific scent.

As shown in FIG. 4, the reservoirs 402 are often retained within acompartment 404 that is readily accessible to the user. For example, thescent delivery system 400 may include a door 406 that can be securelyclosed via fasteners 408, such as magnets, mechanical clips/tracks, anadhesive material, etc. The door 406 enables the user to readily replacethe reservoirs 402 in response to determining new scents are desired ornecessary for content that is to be presented by the HMD. For example,the user may wish to replace some or all of the reservoirs 402 prior towatching a cinematic video, playing a video game, or interacting withaugmented or virtual reality content.

The scent delivery system 400 may also dispense scents from thereservoirs 402 in order to affect the user's sense of taste. HMDs thatshow virtual reality content prevent users from being able to see theirhands (and, more specifically, what they are eating or drinking whileviewing the digital content). However, there is a strong physiologicalconnection between different sources of sensory information. Forinstance, the ability to recognize flavors is often affected by visualinformation and olfactory information. The HMDs and scent deliverysystems described herein can make use of these physiological connectionsto trick the user's senses.

For example, a user could be tricked into believing that water is asweeter drink by having the HMD display a sweet drink and/or by havingthe scent delivery system 400 dispense a sweet scent. Similarly, theuser could be tricked into believing a wine is much stronger or betterthan it actually is (e.g., by presenting a picturesque vineyard and/ordispensing an appropriate smell). The scent delivery systems describedherein can be used to make generally bland foods seem more salty, spicy,bitter, or sour by modifying the content that is presented to the userby the HMD and/or the scent(s) that are dispensed by the scent deliverysystem 400.

As noted above, the scent delivery system 400 could also store materialsthat include a flavor compound having a particular taste. Consequently,visual, olfactory, and/or gustatory experiences can be selectivelymodified in order to improve the user experience (e.g., by enhancinggood flavors or replacing bad flavors). In some embodiments the scentdelivery system 400 includes separate reservoirs for storing materialshaving a scent-enabling compound and materials having a taste-enablingcompound, while in other embodiments the scent-enabling compound and thetaste-enabling compound are included in the same material that is storedin a single reservoir.

FIG. 5A depicts capsules 502 a-c of scented material (e.g., liquid orair) that can be installed within a scent delivery system. As notedabove, the capsules may correspond to general scents (e.g., sweet,savory, and floral) or specific scents (e.g., cinnamon, pine, androses). Similar scents are often sufficient to enable a user toaccurately remember or replicate previous experiences. Thus, a scentdelivery system may be configured to dispense a floral scent regardlessof whether the HMD is displaying a garden of roses or a field of tulips.Most individuals imprint their prior knowledge on basic scents (and,thus, do not need to experience a specific scent in order to believe anexperience is authentic). For example, a general sweet scent could besufficient to trick the user regardless of whether the digital contentbeing shown involves cakes, cookies, candy, etc.

The capsules 502 a-c could also be designed to be experienced inconjunction with certain content (e.g., audio files, cinematic videos,or interactive digital content, such as augmented or virtual realitycontent). Consequently, one or more capsules could be distributed withmovies, audiobooks, video games, etc., that are to be experienced via anHMD or some other computing device (e.g., computing device 306 of FIG.3). For example, a sports-themed video game 504 could be packaged with acapsule that includes a hot dog scent or a popcorn scent (or some otherscent that would be commonly experienced at an athletic event).Similarly, a baking-themed television program could be packaged with acapsule having a general sweet scent or multiple capsules correspondingto specific scents, such as cinnamon, vanilla, and chocolate.

The capsule(s) 502 a-c can be acquired in several different ways. Forexample, the user may acquire one or more capsules when purchasing aphysical copy of the content (e.g., a compact disc (CD), digital videodisc (DVD), or Blu-ray Disc™). As another example, the user may downloadan instruction set for dispensing scented material(s) upon purchasing adigital copy of the content. In such embodiments, the instruction setmay specify different combinations of scents that are commonly available(i.e., the source of the content may rely on the user already havingcertain scented material(s) available). The instructions may be embeddedin the content (e.g., in the metadata of a cinematic video) or includedin a separate file that is downloaded along with the digital copy of thecontent.

FIG. 5B depicts a user device 506 that is able to access an interface508 for interacting with an HMD and/or a scent delivery system. Theinterface 508 may allow a user to customize a sensory experience, suchas an olfactory experience enabled by content that supports scentfunctionality (e.g., sports-themed video game 504). For example, theuser may opt to decrease the intensity of the dispensed scent(s) ordisable scent functionality in its entirety. The interface 508 may alsoallow the user to ensure that the scent delivery system and/or therelevant content are appropriately connected/uploaded to the HMD. Theinterface 508 may also enable the enable or modify other sensoryexperiences (e.g., gustatory experiences or touch experiences, such assimulated wind or rain).

One skilled in the art will recognize that entirely new experiences canalso be developed for HMDs that are able to dispense scent(s). Forexample, a first user could visit a virtual flower shop where the firstuser is able to select a digital flower that is subsequently deliveredto a second user. The digital flower may be associated with a certainscent that is dispensed when the second user receives the digital flowerand attempts to smell it. Delivery of the digital flower and/ordispersal of the certain scent could be manually triggered by the firstuser or automatically triggered by a software program that monitors thesecond user's reactions to receiving the digital flower. Olfactoryexperiences like this could be (and often are) paired with visual,audible, tactile, and/or gustatory experiences to increase realism.

In some embodiments, the scent delivery system and/or the HMD isprogrammable through a network-accessible interface that is accessiblevia a web browser, a mobile application, a desktop software program, orover-the-top (OTT) application. For example, if the digital flower isintended to be a gift on the second user's birthday, the first usercould set the delivery for a particular day or time.

The same interface (or an entirely different interface) may allow a userto adjust the concentration or amount of scented material(s) dispensedby the scent delivery system. For example, the user might elect todecrease the intensity of scent(s) created by the scent delivery systemor prevent certain types of scents (e.g., floral scents or salty scents)from being created, such as those scents to which the user is sensitiveor allergic.

FIG. 5C depicts an interface through which a user can browse itemsoffered for sale by an electronic commerce platform, which could rangein size from large retailers (e.g., Amazon.com®) that sell a wideassortment of products to small retailers that sell a single product.The interface may be viewed by the user on an HMD or some othercomputing device (e.g., computing device 306 of FIG. 3). A scentdelivery system communicatively coupled to the HMD or the othercomputing device may enable scent-based browsing of the items offeredfor sale.

For example, a user may execute a search for perfumes or colognesthrough the interface, and then browse different items returned by thesearch. Similarly, the user might visit a virtual perfume shop orcologne shop where the user is able to view and smell different itemsoffered for sale. As another example, the user could browse scents andpurchase a scent (e.g., as part of a gift that is paired with acinematic movie, digital card, etc.) that will be experienced by theuser or another user.

A scent delivery system may permit the user to test the scents ofdifferent physical items (e.g., perfumes or colognes) before placing anonline order for a physical item. Said another way, the scent deliverysystems introduced here may enable scent-based browsing. Although thescent of a perfume or cologne is not likely to be replicated exactly,the scent(s) dispensed by a scent delivery system enable the user tohave a better understanding of what he/she is buying (e.g., whether aperfume/cologne is intended to have a sweet fragrance, a floralfragrance, etc.).

As noted above, scent delivery systems dispense scent(s) upon executinginstructions that correspond to the content being presented to the user.Here, for example, the scent delivery system can determine whether todispense a scent based on instructions provided by a source of thecontent (e.g., a producer of a cinematic video or a merchant associatedwith an electronic commerce platform). In some embodiments theinstructions are embedded within the content (e.g., in the metadata of acinematic video), while in other embodiments the instructions areincluded in an instruction set that accompanies the content and isseparately executable by the processor.

Moreover, the instructions could be initially created in severaldifferent ways. For example, a manufacturer of the item (e.g., a perfumemanufacturer) may select scent(s) from a list of scents that arecommonly available to scent delivery systems. As another example,instructions could be automatically created by parsing a product listingto identify tag words that are used to describe the item. The tagword(s) may be used to identify the scent(s) that are most appropriate.One skilled in the art will recognize that these different techniquesfor creating instructions enable different levels of control indispensing scents and accuracy in replicating fragrances. For instance,instructions provided by the manufacturer of the item are generally moreaccurate than instructions that are automatically created (e.g., by aservice responsible for supporting scent functionality) based oninformation about the item.

Content (e.g., audiobooks and digital content, such as applications,games, and cinematic videos) can be specially designed for use with anHMD having a scent delivery system. However, older, non-scented contentcould also be repurposed for use with HMDs having a scent deliverysystem. For example, an administrator (e.g., a designer, writer, orindividual consumer of content) may be able to tag older, non-scentedcontent to create keyframes that cause the scent delivery system todispense one or more scents. More specifically, the administrator couldupload the older, non-scented content to an interface and manuallyspecify which scent(s) should be dispensed, how much of each scentshould be dispensed (e.g., a faint, medium, or strong aroma), when eachscent should be dispensed, etc. A repurposing engine that is responsiblefor generating the interface may also be configured to automaticallyrecommend these criteria (e.g., scent type, dispersal time, dispersalquantity) after reviewing and analyzing the older, non-scented content.Thus, older, non-scented content could be manually repurposed intoscented content by an administrator and/or automatically repurposed intoscented content by a repurposing engine. The older content could benon-visual content, such as an audiobook, or visual content, such astwo-dimensional (2D) content or three-dimensional (3D) content.

FIG. 6 depicts a process 600 for attaching a scent delivery system to anHMD. One skilled in the art will recognize, however, that the scentdelivery system could also be built into the HMD itself. A scentdelivery system is initially provided to a user (e.g., an individualconsumer of content, such as augmented or virtual reality content) (step602). The scent delivery system could be designed to be paired with anyHMD, a specific subset of HMDs (e.g., only those HMDs configured topresent virtual reality content), or a specific type of HMD (e.g.,Oculus Rift®, Microsoft HoloLens®, etc.).

Oftentimes, the scent delivery system will include one or more fastenersthat enable the scent delivery system to be readily attached to, andthen removed from, an HMD (step 604). For example, the structural frameof the HMD may include fasteners (e.g., cavities) configured to matewith corresponding features (e.g., protrusions) of a scent deliverysystem. In other embodiments, the scent delivery system is fixedlyattached to the frame of the HMD using, for example, screws, nuts andbolts, or an adhesive material.

The user may also be able to readily replace one or more capsules housedwithin the scent delivery system (step 606). For example, in someembodiments the scent delivery system includes a compartment that isaccessible when the scent delivery system is attached to the HMD, whilein other embodiments the compartment is only accessible when the scentdelivery is not attached to the HMD. The capsules could also be housedwithin a separate compartment that is connected to the scent deliverysystem. For example, a separate compartment that includes multiplecapsules could be affixed to the side or back of the HMD. In suchembodiments, the scent delivery system (or the HMD itself) can includechannels for routing scented materials from the multiple capsules topump(s) disposed near the user's nose.

The scent delivery system and/or the HMD can enable the user to modifywhether a scent feature (also referred to as a “scent functionality”) isenabled or disabled (step 608). For example, the scent delivery systemcould include a mechanical on/off switch or the HMD could display anelectronic interface that allows the user to select whether the scentfeature is engaged. When the scent feature is enabled, one or morescents can be dispensed by the scent delivery system (step 610). Morespecifically, the scent(s) can be dispensed at certain points in time,in response to determining a particular type of digital content is beingshown, etc.

In some embodiments, scent circuitry (and, more specifically, acontent-monitoring module) causes a scent to be automatically dispensedby the scent delivery system in response to determining a particularscene of digital content is being shown by the HMD. For example, animage of a field of flowers could trigger the production of a floralscent, while an ocean view may trigger the production of a salty scent.Additionally or alternatively, the production of a scent could bemanually triggered by the user (e.g., by pushing a mechanical button onthe scent delivery system or HMD, or by audibly delivering a command).Similarly, the production of a scent could be triggered by the scentcircuitry based on motion data received from one or more motion sensors(e.g., inertial sensors or accelerometers) that are coupled to the HMDand/or the scent delivery system. When we want to smell an object inreal life, we typically move our head closer to the object. In someembodiments, the HMD and/or the scent delivery system is able toreplicate that experience by producing scent(s) in response todetermining the user's head has begun moving toward where a digitalobject is presented in a digital environment. For example, the scentdelivery system may dispense a floral scent upon determining that theuser's head has moved toward the theoretical position of a digitalflower, and then stop dispensing the floral scent upon determining theuser's head has begun moving away from that position.

In some embodiments, the scent delivery system and/or the HMD facilitatedispersal of the scent(s) after a predetermined time period or inresponse to an action completed by the user. For example, a fan may beconfigured to periodically or continuously circulate air around theuser's nose. As another example, a fan could begin running or moresubtle scent(s) could be dispensed upon determining the user hasperformed an action with respect to the content being presented by theHMD (e.g., the user moves to a different virtual reality environment).

FIG. 7 depicts a process 700 for dispensing one or more scentedmaterials by a scent delivery system that is attached to an HMD.Initially, scent circuitry of the scent delivery system receives anindication that a scent feature has been enabled (step 702). As notedabove, the scent feature could be enabled using a mechanical switch onthe scent delivery system, an electronic interface presented by the HMD,etc. The scent circuitry, meanwhile, can include a power supply, memory,processor(s), and/or communication module(s) that enable the scentdelivery system to communicate with the HMD across a wired or wirelesscommunication channel.

The scent delivery system can monitor the content presented by the HMD(step 704). The content could be, for example, visual content (e.g.,cinematic videos, applications, or video games) or non-visual contentsuch as audio files. The scent delivery system can then generate anoutput signal in response to determining a particular keyframe of thecontent has been reached (step 706). The term “keyframe” refers to aninstance within the content (e.g., a visual frame or an audio frame)that causes one or more scented materials to be dispensed. The term canapply regardless of whether the experience is visual or non-visual. Forexample, both cinematic videos and audiobooks can have keyframe(s)arranged throughout their runtime.

The output signal could also include other metadata about the scentedmaterial(s) to be dispensed. For example, the output signal couldspecify which scented material(s) should be dispensed and the intensity(i.e., amount) of each scented material. The output signal (and anycorresponding metadata) can be generated by a software module based onvarious user characteristics, such as age, gender, lifestyle, etc. Forexample, scent intensity may be increased proportional to the age of theuser.

Typically, the output signal is transmitted to the scent circuitry ofthe scent delivery system (step 708). The scent circuitry is able toprocess the output signal in order to determine which scentedmaterial(s) are to be dispensed, how much of each scented materialshould be dispensed, etc. The scent circuitry can then cause pump(s) todispense the scented material(s) toward the user's nose (step 710). Theamount of scented material(s) released by the pump(s) may correspond tothe content being presented by the HMD. For example, the amount ofscented material dispensed by a pump may be reduced if the user isconcurrently experiencing visual stimulation (i.e., digital content)that is related to the scent. Said another way, smaller amounts ofscented material may be required when the user is also expected toexperience significant visual stimulation and/or audible stimulation.For example, only a small amount of lemon scent may be necessary if abowl of lemons or a pitched of lemonade are viewable at the same time,while a larger quantity of lemon scent may be needed if the user iswalking through a digital citrus grove whose fruit is not easilyviewable. Thus, scent circuitry may consider what each of the user'sother senses are expected to experience at a given time. Realisticsimulation of digital content requires that the strength, direction,frequency, and other features of any sensory stimuli must generallycorrespond to what is being presented by the HMD.

The scent delivery system and/or the HMD can also be configured tomonitor the user's reaction to the scent (step 712). In someembodiments, the HMD and/or the scent delivery system includetemperature sensor(s) that monitor whether the user's temperature hasbegun to rise and/or humidity sensor(s) that monitor whether the userhas begun to sweat. Both of these occurrences may indicateoverstimulation of the user's senses. Similarly, the HMD and/or thescent delivery system may include motion sensor(s) that monitor whetherthe user begins to move her head away from where the digital content istheoretically presented or whether the user has begun to shake her head.These actions may indicate the dispensed scent is too strong.Consequently, a fan may begin circulating the air around the user's noseor a neutralizing scent may be dispensed to eliminate or dilute thestrong scent.

Unless contrary to physical possibility, it is envisioned that the stepsdescribed above may be performed in various sequences and combinations.For example, in some embodiments the user must replace the capsule(s)before the scent delivery system is attached to the HMD. Additionalsteps could also be included in some embodiments. In fact, other stimuli(e.g., gustatory or tactile, such as simulated wind) could also bealtered based on the user's reaction. For example, the intensity of anair flow created by a fan (which is intended to simulate wind) may belessened if one or more motion sensors indicate the user has begunturning her head away from the fan (i.e., away from the source of thestimulus).

Processing System

FIG. 8 is a block diagram illustrating an example of a processing system800 in which at least some operations described herein can beimplemented. The computing system may include one or more centralprocessing units (“processors”) 802, main memory 806, non-volatilememory 810, network adapter 812 (e.g., network interfaces), videodisplay 818, input/output devices 820, control device 822 (e.g.,keyboard and pointing devices), drive unit 824 including a storagemedium 826, and signal generation device 830 that are communicativelyconnected to a bus 816. The bus 816 is illustrated as an abstractionthat represents any one or more separate physical buses, point to pointconnections, or both connected by appropriate bridges, adapters, orcontrollers. The bus 816, therefore, can include, for example, a systembus, a Peripheral Component Interconnect (PCI) bus or PCI-Express bus, aHyperTransport or industry standard architecture (ISA) bus, a smallcomputer system interface (SCSI) bus, a universal serial bus (USB), IIC(I2C) bus, or an Institute of Electrical and Electronics Engineers(IEEE) standard 1394 bus, also called “Firewire.”

In various embodiments, the processing system 800 operates as part of anHMD (e.g., HMD 200 of FIG. 2), although the processing system 800 may beconnected (e.g., wired or wirelessly) to the HMD. In a networkeddeployment, the processing system 800 may operate in the capacity of aserver or a client machine in a client-server network environment, or asa peer machine in a peer-to-peer (or distributed) network environment.

The processing system 800 may be a server, a personal computer (PC), atablet computer, a laptop computer, a personal digital assistant (PDA),a mobile phone, a processor, a telephone, a web appliance, a networkrouter, switch or bridge, a console, a hand-held console, a (hand-held)gaming device, a music player, any portable, mobile, hand-held device,or any machine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by the processing system.

While the main memory 806, non-volatile memory 810, and storage medium826 (also called a “machine-readable medium”) are shown to be a singlemedium, the term “machine-readable medium” and “storage medium” shouldbe taken to include a single medium or multiple media (e.g., acentralized or distributed database, and/or associated caches andservers) that store one or more sets of instructions 828. The term“machine-readable medium” and “storage medium” shall also be taken toinclude any medium that is capable of storing, encoding, or carrying aset of instructions for execution by the computing system and that causethe computing system to perform any one or more of the methodologies ofthe presently disclosed embodiments.

In general, the routines executed to implement the embodiments of thedisclosure, may be implemented as part of an operating system or aspecific application, component, program, object, module or sequence ofinstructions referred to as “computer programs.” The computer programstypically comprise one or more instructions (e.g., instructions 804,808, 828) set at various times in various memory and storage devices ina computer, and that, when read and executed by one or more processingunits or processors 802, cause the processing system 800 to performoperations to execute elements involving the various aspects of thedisclosure.

Moreover, while embodiments have been described in the context of fullyfunctioning computers and computer systems, those skilled in the artwill appreciate that the various embodiments are capable of beingdistributed as a program product in a variety of forms, and that thedisclosure applies equally regardless of the particular type of machineor computer-readable media used to actually effect the distribution.

Further examples of machine-readable storage media, machine-readablemedia, or computer-readable (storage) media include, but are not limitedto, recordable type media such as volatile and non-volatile memorydevices 810, floppy and other removable disks, hard disk drives, opticaldisks (e.g., Compact Disk Read-Only Memory (CD ROMS), Digital VersatileDisks (DVDs)), and transmission type media, such as digital and analogcommunication links.

The network adapter 812 enables the processing system 800 to mediatedata in a network 814 with an entity that is external to the processingsystem 800 through any known and/or convenient communications protocolsupported by the processing system 800 and the external entity. Thenetwork adapter 812 can include one or more of a network adaptor card, awireless network interface card, a router, an access point, a wirelessrouter, a switch, a multilayer switch, a protocol converter, a gateway,a bridge, bridge router, a hub, a digital media receiver, and/or arepeater.

The network adapter 812 can include a firewall which can, in someembodiments, govern and/or manage permission to access/proxy data in acomputer network, and track varying levels of trust between differentmachines and/or applications. The firewall can be any number of moduleshaving any combination of hardware and/or software components able toenforce a predetermined set of access rights between a particular set ofmachines and applications, machines and machines, and/or applicationsand applications, for example, to regulate the flow of traffic andresource sharing between these varying entities. The firewall mayadditionally manage and/or have access to an access control list whichdetails permissions including for example, the access and operationrights of an object by an individual, a machine, and/or an application,and the circumstances under which the permission rights stand.

As indicated above, the techniques introduced here implemented by, forexample, programmable circuitry (e.g., one or more microprocessors),programmed with software and/or firmware, entirely in special-purposehardwired (i.e., non-programmable) circuitry, or in a combination orsuch forms. Special-purpose circuitry can be in the form of, forexample, one or more application-specific integrated circuits (ASICs),programmable logic devices (PLDs), field-programmable gate arrays(FPGAs), etc.

Remarks

The foregoing description of various embodiments of the claimed subjectmatter has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit the claimedsubject matter to the precise forms disclosed. Many modifications andvariations will be apparent to one skilled in the art. Embodiments werechosen and described in order to best describe the principles of theinvention and its practical applications, thereby enabling othersskilled in the relevant art to understand the claimed subject matter,the various embodiments, and the various modifications that are suitedto the particular uses contemplated.

While embodiments have been described in the context of fullyfunctioning computers and computer systems, those skilled in the artwill appreciate that the various embodiments are capable of beingdistributed as a program product in a variety of forms, and that thedisclosure applies equally regardless of the particular type of machineor computer-readable media used to actually effect the distribution.

Although the above Detailed Description describes certain embodimentsand the best mode contemplated, no matter how detailed the above appearsin text, the embodiments can be practiced in many ways. Details of thesystems and methods may vary considerably in their implementationdetails, while still being encompassed by the specification. As notedabove, particular terminology used when describing certain features oraspects of various embodiments should not be taken to imply that theterminology is being redefined herein to be restricted to any specificcharacteristics, features, or aspects of the invention with which thatterminology is associated. In general, the terms used in the followingclaims should not be construed to limit the invention to the specificembodiments disclosed in the specification, unless those terms areexplicitly defined herein. Accordingly, the actual scope of theinvention encompasses not only the disclosed embodiments, but also allequivalent ways of practicing or implementing the embodiments under theclaims.

The language used in the specification has been principally selected forreadability and instructional purposes, and it may not have beenselected to delineate or circumscribe the inventive subject matter. Itis therefore intended that the scope of the invention be limited not bythis Detailed Description, but rather by any claims that issue on anapplication based hereon. Accordingly, the disclosure of variousembodiments is intended to be illustrative, but not limiting, of thescope of the embodiments, which is set forth in the following claims.

1. An apparatus for producing sensory stimuli to increase the realism ofdigital content, the apparatus comprising: a structural frame thatincludes a fastener for detachably connecting the apparatus to ahead-mounted display; multiple containers that each include a scentedmaterial, wherein the multiple containers are removable from theapparatus; and at least one pump configured to controllably dispense thescented materials from the multiple containers to produce scents duringplayback of digital content by the head-mounted display.
 2. Theapparatus of claim 1, further comprising: a processor configured togenerate a control signal that controls how much of each scentedmaterial is dispensed by the at least one pump from the multiplecontainers during playback of the digital content by the head-mounteddisplay.
 3. The apparatus of claim 2, further comprising: a sensorconfigured to measure motion of the apparatus, temperature of a user,ambient humidity, or any combination thereof.
 4. The apparatus of claim3, wherein the processor lowers scent intensity by decreasing a volumeof scented material dispensed by the at least one pump responsive to adetermination the sensor outputs a value exceeding a threshold.
 5. Theapparatus of claim 1, wherein the structural frame includes an outletthrough which air residing in a cavity formed by the structural framecan escape into an external environment.
 6. The apparatus of claim 5,further comprising: a fan configured to guide air from the cavity to theexternal environment through the outlet of the structural frame.
 7. Theapparatus of claim 1, wherein the multiple containers are housed withina compartment that is accessible when the apparatus is connected to thehead-mounted display.
 8. A method comprising: receiving, by a processor,an indication that a sensory functionality of a sensory stimulusapparatus connected to a head-mounted display is enabled; parsing, bythe processor, digital content presented by the head-mounted display todiscover a keyframe; generating, by the processor, a control signalresponsive to a determination that the keyframe has been shown; andtransmitting, by the processor, the control signal to a pump of thesensory stimulus apparatus, wherein reception of the control signalcauses the pump to dispense a liquid from a reservoir of the sensorystimulus apparatus.
 9. The method of claim 8, wherein the liquid iswater that is dispensed in a controlled manner to simulate a waterfeature shown in the digital content.
 10. The method of claim 8, whereinthe liquid is a scented material that is dispensed in a controlledmanner to produce a scent that corresponds to an item shown in thedigital content.
 11. The method of claim 8, further comprising:monitoring, by the processor, a reaction by a user to the dispersal ofthe liquid; determining, by the processor, that the reaction matches apattern indicative of discomfort; and modifying, by the processor, thecontrol signal to alter a characteristic of the liquid dispensed by thepump.
 12. The method of claim 11, wherein the pattern indicative ofdiscomfort is a head movement away from a fictional source of theliquid, and wherein the characteristic is a volume of liquid dispensedby the pump, a force with which the liquid is dispensed by the pump, orany combination thereof.
 13. The method of claim 11, wherein saidmonitoring comprises: examining, by the processor, an output produced bya sensor connected to the sensory stimulus apparatus or the head-mounteddisplay, wherein the sensor is a motion sensor whose output isindicative of motion of the sensory stimulus apparatus, a temperaturesensor whose output is indicative of skin temperature of the user, or ahumidity sensor whose output is indicative of ambient humidity.
 14. Amethod comprising: receiving, by a processor, an indication that asensory functionality of a sensory stimulus apparatus connected to ahead-mounted display is enabled; parsing, by the processor, digitalcontent presented by the head-mounted display to discover a keyframe;generating, by the processor, a control signal responsive to adetermination that the keyframe has been shown; and transmitting, by theprocessor, the control signal to a fan of the sensory stimulusapparatus, wherein reception of the control signal causes the fan tocreate an air flow in a controlled manner to simulate wind.
 15. Themethod of claim 14, further comprising: monitoring, by the processor, areaction by a user to the air flow; determining, by the processor, thatthe reaction matches a pattern indicative of discomfort; and modifying,by the processor, the control signal to alter a characteristic of theair flow.
 16. The method of claim 15, wherein the pattern indicative ofdiscomfort is a head movement away from a fictional source of the airflow, and wherein the characteristic is a speed of the air flow, atemperature of the air flow, or any combination thereof.
 17. The methodof claim 15, wherein said monitoring comprises: examining, by theprocessor, an output produced by a sensor connected to the sensorystimulus apparatus or the head-mounted display, wherein the sensor is amotion sensor whose output is indicative of motion of the sensorystimulus apparatus, a temperature sensor whose output is indicative ofskin temperature of the user, or a humidity sensor whose output isindicative of ambient humidity.
 18. An apparatus comprising: astructural frame that includes a fastener for connecting the apparatusto a head-mounted display; a container of scented material that isremovable from the apparatus; a pump configured to controllably dispensethe scented material from the container; and a processor configured to:receive input indicative of a selection of an item offered for sale byan electronic commerce platform; determine that the scented materialcorresponds to an actual scent produced by the item in a real-worldenvironment; and generate a control signal that controls how muchscented material is dispensed by the pump following the selection of theitem offered for sale by the electronic commerce platform.
 19. Theapparatus of claim 18, wherein said determining is based on a mapping ofitems to scented materials provided by a merchant responsible forsupplying the item offered for sale by the electronic commerce platform.20. The apparatus of clam 18, wherein said determining is based on oneor more keywords identified within a product listing corresponding tothe item offered for sale by the electronic commerce platform.